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Abstract 

For a given nonnegative integer a, a matrix A„ of size n is called a-Toeplitz if its entries 
obey the rule An = [or-Qs]" s=o- Analogously, a matrix An again of size n is called a-circulant 
if An = [a(^r-as) modn]" ^^q- Sucli kind of matrfccs arises in wavelet analysis, subdivision 
algorithms and more generally when dealing with multigrid/multilevel methods for structured 
matrices and approximations of boundary value problems. In this paper we study the singular 
values of a-circulants and we provide an asymptotic analysis of the distribution results for the 
singular values of a-Toeplitz sequences in the case where {ak} can be interpreted as the sequence 
of Fourier coefficients of an integrable function / over the domain (— tt, tt). Some generalizations 
to the block, multilevel case, amounting to choose / multivariate and matrix valued, are briefly 
considered. 

Keywords: circulants, Toeplitz, a-circulants, a-Toeplitz, spectral distributions, multigrid meth- 
ods. 
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1 Introduction 



A matrix An of size n is called a-Toeplitz if its entries obey the rule An 
a nonnegative integer. As an example, if n = 5 and a = 3 then 



[ar-as]r sLo^ where a is 



An 



Tn 



ao a-3 a-6 ^-9 a-i2 

01 a_2 o_5 a_8 a-ii 

02 ffl-i a_4 a_7 tj-io 
as ao a_3 a_6 a_9 
04 ai a_2 a-5 a-8 



Along the same lines, a matrix An of size Ti is called a-circulant if An 
For instance if n = 5 and a = 3 then we have 
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Such kind of matrices arises in wavelet analysis [6j and subdivision algorithms or, equivalently, 
in the associated refinement equations, see ^ and references therein. Furthermore, it is interesting 
to remind that Gilbert Strang [22] has shown rich connections between dilation equations in the 
wavelets context and multigrid methods |12[ I29j. when constructing the restriction/prolongation 
operators [9l [1] with various boundary conditions. It is worth noticing that the use of differ- 
ent boundary conditions is quite natural when dealing with signal/image restoration problems or 
differential equations, see [181 [15]. 

In this paper we address the problem of characterizing the singular values of a-circulants and 
of providing an asymptotic analysis of the distribution results for the singular values of a-Toeplitz 
sequences, in the case where the sequence of values {a^}, defining the entries of the matrices, can 
be interpreted as the sequence of Fourier coefficients of an integrable function / over the domain 
(— 7r,7r). As a byproduct, we will show interesting relations with the analysis of convergence of 
multigrid methods given, e.g., in [211 [T]. Finally we generalize the analysis to the block, multilevel 
case, amounting to choose the symbol / multivariate, i.e., defined on the set (— tt, tt)'^ for some 
d > 1, and matrix valued, i.e., such that f{x) is a matrix of given size p x q. 

The paper is organized as follows. In Section [2] we report useful definitions, well-known results 
in the standard case of circulants and Toeplitz that is when a = 1 (or a = e, e = (1,... ,1), 
in the multilevel setting), and a preliminary analysis of some special cases. Section [3] deals with 
the singular value analysis of a-circulants while in Section [4] we treat the a-Toeplitz case in an 
asymptotic setting, and more precisely in the sense of the Weyl spectral distributions. Section [5] 
is devoted to sketch useful connections with multigrid methods, while in Section [6] we report the 
generalization of the results when we deal the multilevel block case. Section [7] is aimed to draw 
conclusions and to indicate future lines of research. 

2 General definitions and tools 

For any n x n matrix A with eigenvalues Xj{A), j = 1, . . . , n, and for any m x n matrix B with 
singular values aj{B), j = 1, . . . ,1, I = min{m, n}, we set 



The matrix B*B is positive semidefinite, since x*{B*B)x = ||-Bx||2 > for all x £ C"', with * 
denoting the transpose conjugate operator. Moreover, it is clear that the eigenvalues Xi{B*B) > 
\2{B*B) > • • • > Xn{B*B) > are nonnegative and can therefore be written in the form 



with cjj > 0, j = 1, . . . , n. The numbers cti > cr2 > • • • > cr; > 0, / = min{m, n}, are called singular 
values of B, i.e., aj = (Tj{B) and if n > I then Xj{B*B) = 0, j = I + 1, . . . ,n. A more general 
statement is contained in the singular value decomposition theorem (see e.g. jllj). 

Theorem 2.1. Let B be an arbitrary (complex) m x n matrix. Then: 

(a) There exists a unitary m x m matrix U and a unitary n x n matrix V such that U*BV = S 
is an m X n "diagonal matrix" of the following form: 



Eig(A) = {Ai(A), X2{A), . . . , A„(^)}, Sgval(S) 



{ai{B),a2{B),...,ai{B)}. 



Xj{B*B) 




(1) 



S = 



D 




D := diag((7i, . . . , ar), ai > a2 > • • • > CTr > 0. 



Here a\ 



. . . ,ar are the nonvanishing singular values of B, and r is the rank of B. 
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(b) The nonvanishing singular values of B* are also precisely the number ai, . . . ,ar- 
The decomposition B = UTiV* is called "the singular value decomposition of B ". 

For any function F defined on M.q and for any m xn matrix A, the symbol A) stands for 

the mean 

min{n,m} 

S.(F,^):=— Fic^M)) = —. r ^ F{a). (2) 

' j=l I ' J <7eSgval(A) 

Throughout this paper we speak also of matrix sequences as sequences {A^,} where Ai^ is an 
n{k) X m{k) matrix with min{n(A;), m(A;)} — > cxd as A; ^ oo. When n{k) = m{k) that is all the 
involved matrices are square, and this will occur often in the paper, we will not need the extra 
parameter k and we will consider simply matrix sequences of the form {An}- 

Concerning the case of matrix-sequences an important notion is that of spectral distribution in 
the eigenvalue or singular value sense, linking the collective behavior of the eigenvalues or singular 
values of all the matrices in the sequence to a given function (or to a measure). The notion goes 
back to Weyl and has been investigated by many authors in the Toeplitz and Locally Toeplitz 
context (see the book by Bottcher and Silbermann [4j where many classical results by the authors, 
Szego, Avram, Parter, Widom Tyrtyshnikov, and many other can be found, and more recent results 
in [ini US [231 [28l [261 [27| ) . Here we report the definition of spectral distribution only in the singular 
value sense since our analysis is devoted to singular values. The case of eigenvalues will be the 
subject of future investigations. 

Definition 2.1. Let Co(M^) be the set of continuous functions with bounded support defined over 
the nonnegative real numbers, d a positive integer, and 9 a complex-valued measurable function 
defined on a set G C M"^ of finite and positive Lebesgue measure /u(G). Here G will be often equal to 
(— vr, n)'^ so that e**^ = T'^ with T denoting the complex unit circle. A matrix sequence {^4^} is said 
to be distributed {in the sense of the singular values) as the pair {9,G), or to have the distribution 
function 9 ({A^} ~o- {9,G)), if, VF G Co(M(j'), the following limit relation holds 

lim J:^{F,Ak) = [ F{\9{t)\)dt, t = {ti,...,td). (3) 

When considering 9 taking values in Mpg, where Mpq is the space of p x g matrices with complex 
entries and a function is considered to be measurable if and only if the component functions are, 
we say that {^a;} ~(t {G,G) when for every F S Co(Mq") we have 



1 



hm S<,(F,A,) = — - / ^^-^ . \ V '^^^ t = {t,,...,td), 



with aj{9{t)) = y^Xj{9{t)9*{t)) = Xj{y/9{t)9*{t)). Finally we say that two sequences {At} and 
{Bk} are equally distributed in the sense of singular values (cr) if, \/F G Co(MjJ'), we have 

lim [^^{F,Bk)-^AF,Ak)]=0. 

Here we are interested in explicit formulae for the singular values of a-circulants and in distri- 
bution results for a- Toeplitz sequences. In the latter case, following what is known in the standard 
case of a = 1 (or a = e in the multilevel setting) , we need to link the coefficients of the a-Toeplitz 
sequence to a certain symbol. 
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Let / be a Lebesgue integrable function defined on (— vr, vr)'^ and taking values in M-pq, for given 
positive integers p and q. Then, for d-indices r = (n, . . . , r^), j = (ji, . . . , j^), n = (ni,...,nrf), 
e = (1, . . . , 1), = (0, . . . , 0), the Toephtz matrix Tn{f) of size ph x qh, n = ni • 77-2 • • • n^, is defined 
as foUows 

2n(/) = [fr-j]rj=0^ 

where fk are the Fourier coefficients of / defined by equation 

= f(n,-jAf) = / • • • ' t,)e-'^^^'^^-^^^'^^ dt,--- dtd, = -1, (4) 

for integers ji such that —00 < ji < 00 for 1 < i < d. Since / is a matrix- valued function of d 
variables whose component functions are all integrable, then the (ji, . . . ,jd)-th Fourier coefficient 
is considered to be the matrix whose (n, u)-th entry is the (ji, . . . ,jd)-th Fourier coefficient of the 
function (/(ti, . . . ,td))u,v 

According to this multi-index block notation we can define general multi-level block a-Toeplitz 
and a-circulants. Of course, in this multidimensional setting, a denotes a d-dimensional vector of 
nonnegative integers that is a = (ai, . . . , ad)- In that case = [ar-aos]"7=o where the o operation 
is the componentwise Hadamard product between vectors or matrices of the same size. A matrix 
An of size pn x qh is called a-circulant if An = [a(r-aos) modn]"^^o' ^^^^^'^ 

{r — a o s) mod n = ((ri — QiSi) mod rii, (r2 — 0282) mod n2, . . . , (r^ — adSd) mod n^) . 

2.1 The extremal cases where a = or a = e, and the intermediate cases 

We consider a d-level setting and we analyze in detail the case where < q < e and with < denoting 
the componentwise partial ordering between real vectors. When a has at least a zero component, 
the analysis can be reduced to the positive one as studied in Subsection 12.1.31 

2.1.1 a = e 

In the literature the only case deeply studied is the case oi a = e (standard shift in every level). 
Here for multilevel block circulants An = [a(r-aos) mod n]" 7=o singular values are given by those 
of 

n—e 

ak{An) = J^a,e*2.(i,/ciM+...+i,fc,/n,)^ ^ ^ ^^^^ ^ ^^^^^ 

j=0 

for any ki such that < ki < n£ — l, i = 1, . . . ,d. Of course when the coefficients aj comes from the 
Fourier coefficients of a given Lebesgue integrable function /, i.e. fj = aj modn; j = —"-72, . . . , n/2 
(n/2 = (ni/2, 712/2, . . . ,nrf/2)), the singular values are those of n/2-th Fourier sum of / evaluated 
at the grid points 

2TTk/n = 27r {ki/m, ... , kd/ud) , 

< kj < rij — 1, j = I, . . . ,d. Moreover the explicit Schur decomposition is known. For d = p = 
q = 1 any standard circulant matrix can be written in the form 

An = Cn = FnDnF;:, (5) 
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where 



7? 

D„ 



1 



27rijk 



/n L 
diag(\/nF^a 



n-l 



, Fourier matrix, 



(6) 



a = [ao, oi, • • • , fln-i] 7 first column of the matrix 
Of course for general d, p, q the formula generalizes as 

An = {Fn ® Ip)Dn{F* (g, Iq), 

with Fn = Fni Fn2 • • • (SD Fn^ Dn = diag(\/^(-F'n ® Ip)Ql}-i where n = ni ■ n2 ■ ■ ■ Ud and a being 
the first "column" of A„ whose entries a^, j = (j'l, . . . , ordered lexicographically, are blocks of 
size p X q. 

For multilevel block Toeplitz sequences {r„(/)} generated by an integrable d variate and matrix 
valued symbol / the singular values are not explicitly known but we know the distribution in the 
sense of Definition I2.lt see |26) . More precisely we have 



{Tnif)}^aif,Q''), Q=i-7T,n). 



(7) 



2.1.2 



a 







The other extreme is represented by the case where a is the zero vector. Here the multilevel block 
a-circulant and a-Toeplitz coincide when = and are both given by 



-Ar. 



^{r—Oos) mod n\r,s=0 



[o-r mod n\r,s=0 



^T-Jr,s=0 



ao 



ao 



A simple computation shows that all the singular values are zero except for few of them given 
by \/Jia, where h = ni ■ n2 ■ ■ ■ Ud and a is any singular value of the matrix (X]j=o '^j^j)^^'^- Of 
course in the scalar case where p = q = 1 the choice of a is unique and by the above formula it 
coincides with the Euclidean norm of the first column a of the original matrix. In that case it is 
evident that 

{An} ~. (0,G), 

for any domain G satisfying the requirements of Definition 12.11 
2.1.3 When some of the entries of a vanish 

The content of this subsection reduces to the following remark: the case of a nonnegative a can 
be reduced to the case of a positive vector so that we are motivated to treat in detail the latter in 
the next section. Let a be a d-dimensional vector of nonnegative integers and let C {1, . . . ,d} 
be the set of indices such that j € if and only if aj = 0. Assume that M is nonempty, let t > 1 
be its cardinality and = d — t. Then a simple calculation shows that the singular values of the 
corresponding a-circulant matrix An = [a(r-Qos) mod n]" 7=o ^^^^ except for few of them given 
by Y^n[0]cj where 



h[0] 



n ^j-' 



= {nji,- ■ -^nj,), M = {ji, . . . ,jt], 
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and fj is any singular value of the matrix 




(8) 

Here Cj is a d"'"-level a"'"-circulant matrix with a"*" = {oki, ■ ■ ■ ,ctk^^) and of partial sizes n[> 
0] = (nfcj , . . . , nfc^^ ) , = {ki, . . . , k^+}, and whose expression is 

r =\n -|n[>0]-e 
j [""(r— aos) modn] J,/ gi—Q ) 

where (r — a o s)k = jk for = and r'- = r^. , = s^. , i = 1, . . . , d~^. Taking into account 
the above notation, for the a-Toeplitz = [ar-aos]r~^lQ the same computation shows that all the 
singular values are zero except for few of them given by y^^^o" where a is any singular value of 
the matrix 

1/2 

(9) 

Here Tj is a d"'"-level a"^-Toeplitz matrix with = (ofcu • • • 7Ctk^+) ^-nd of partial sizes n[> 
0] = (nfcu • • • ,nk^^), N*-^ = {/ci, . . . ,kfi+}, and whose expression is 

rp _ r -|?i[>0]-e 

where (r — a o s)k = jk for = and r- = r^., s- = s^., i = 1, . . . Also in this case, since 
most of the singular values are identically zero, we infer that 

{An} ~. (0,G), 

for any domain G satisfying the requirements of Definition 12. li 




3 Singular values of a-circulant matrices 

Of course the aim of this paper is to give the general picture for any nonnegative vector a. Since the 
notations can become quite heavy, for the sake of simplicity, we start with the case d = p = q = 1. 
Several generalizations, including also the degenerate case in which a has some zero entries is 
treated in Section [6] via the observations in Subsection 12.1.31 which imply that the general analysis 
can be reduced to the case where all the entries of a are positive, that is aj > 0, j = 1, . . . , d. 

In the following, we denote by (n, a) the greater common divisor of n and a. i.e., (n, a) = 
gcd(n, a), by Ua = ^^"^^ , by d = j^^^, and by It the identity matrix of order t. 

If we denote by Cn the classical circulant matrix (i.e. with a = 1) and by Cn,a the a-circulant 
matrix generated by its elements, for generic n and a one verifies immediately that 

Cn,a = CnZn,a, (10) 

where 

. / 1 if = (mod n), , , 

Zn,a = [6r-as]r,s=0^ 5fc = q otherwise. ^^^^ 
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Lemma 3.1. Let n be any integer greater than 2 then 



^n,a\^n,a\ ' ' ' \ ^n,a 



(12) 



{n,a) times 



where Zn,a is the matrix defined in and Zn,a G C"^"-" {g the suhmatrix of Zn,OL obtained by 
considering only its first columns, that is 



Proof. Setting ZnX = Zn^a and denoting by Zn,a G C"'^"" the (j + l)-th block-column of the matrix 
Zn^a for j = 0, . . . , (n, a) — 1, we find 



Zn,a — Zji a 



I. 



(13) 



For r = 0, 1, 



Z(0) I I ... I 7((n,a)-l) 

^n,a I ^n,a I I ^n,a 

, n — 1 and s = 0, 1, . . . , no, — 1, we observe that 



and 



(Zn ,a)r,jn, 



Jr-a(jna+s) 



-'r—jaua—cts 



(a) 



{Z^ 



where = and (a) is a consequence of the fact that j^^^ is an integer greater than zero 

and so jaua = jj-^n = (mod n). Thus we conclude that Zna = Zna = Zna for j = 
0, . . . , (n, a) — 1. 

Another useful fact is represented by the following equation 

Zn,a — Zn^(n,a)^na,aj 

where Zn a is the matrix defined in (IllD of dimension Therefore 



□ 



(14) 



r,s=0 



1 if A; = (mod Ua) 
otherwise. 



(15) 



Relation (jl4p will be used later. 
Proof, (of relation ([HI).) For r = 0, 1, . . . , n — 1 and s = 0, 1, . . . , ria — 1, we find 



^(r— os) mod ni 
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and 



1=0 



^r— (ra,a)-(as) mod Ua 



-'I— as 

1=0 

= 6r 
(a) 

= 6 



s I mod no 



r-(n,a)-f 

~~ "^r— (as) mod n 
(b) 

"^(r— (os) mod n) mod n 
^(r—as) mod n) 



where 



(a) holds true since there exists a unique / G {0, 1, . . . , — 1} such that I — as = (mod Ua), 

that is, / = as (mod Ha) and hence 6r-(n,a)l = Sr-{n,a)-{as) modn^; 

(b) is due to the following property: if we have three integer numbers p, 6, and 7, then 

p{9 mod 7) = {p9) mod pj. 

□ 

Lemma 3.2. If a > n then Zn^a = ■^n,a° where a° is the unique integer which satisfies a = tn + a° 
with < a° < n and t £ N; Zn^a is defined in ([77]) . 



Remark 3.1. One can define a° by: a° := a mod n. 
Proof. From (jlip we know that 



Zn,a — ['^r'— ac].^ c=0 ' 



1 if k = (mod n), 
otherwise. 



For r, s = 0, 1, . . . , re — 1, one has 

{Zn,a")r,s — ^r—as — ^r—{tn+a°)s — ^r—a°s — (■^n,«°)r,S) 

since tns = (mod re). Whence Z^^a ~ Zn/^o, □ 

The previous lemma tells us that, for a-circulant matrices, we can consider only the case where 
< a < re. In fact, if a > re, from (IIOD we infer that 



Cn,a — CnZn,a — CnZn,a° — Cn,a° ■ 

Finally, it is worth noticing that the use of ([5]) and (jlOj) implies that 

Formula ()16p plays an important role for studying the singular values of the a-circulant matrices. 



3.1 A characterization of Z„ ^ in terms of Fourier matrices 

Lemma 3.3. Let Fn be the Fourier matrix of order n defined in ^ and let Z^^a S C"^"° he the 
matrix represented in (j j^p . Then 



F Z 



T F Z - 



where In a G C"^"° and 



(17) 



I-ria 




Iria 






j 







(n, a) times, 



with In^ being the identity matrix of size Ua and Zn^ ^q, as in (I jjp . 
Remark 3.2. n = n^- {n,a). 

Proof, (of Lemma 13.31 ) Rewrite the Fourier matrix as 

-Pji = —F= [ /o I /l I /2 I • • • I fn-l ] , 

where fk, A; = 0, 1, 2, . . . , n — 1, is the k — th column of the Fourier matrix of order n: 



2'Kikj 



n—1 
3=0 







27rifc-0 




e~ 


n 






27rifc-l 




e~ 


n 


1 




27rifc-2 




e~ 


n 



27rzfc-(n-l) 



(18) 



From (jl4p . we find 

FnZn,a = FnZn,{n,a)ZnaA = — ^ [ /o | fl-(n,a) \ /2(n,o) | | f(na-l)-{n,a) ] -^ncO ^ {[^"X^Q^ ^jg) 



n 



Indeed, for A; = 0, 1, . . . , no, — 1, j = 0, 1, . . . , n — 1, one has 



n-l 



n-1 



FnZnAn,a) ) — / iF'n) j,l{Zn,(n,a))l,k — / ^Sl-(n,a)ke' 
' j,k '—^ '—^ 



2-iTijL 



(20) 



1=0 



1=0 



and, since < {n,a)k < n — (n,a), there exists a unique G {0, 1, 2, . . . , n — 1} such that 
h — {n,a)k = (mod n), so 1^ = {n,a)k. Consequently relation ([20]) implies 



FnZn,{n,a) 



j,k 



2-Kijlj^ 2nij{n,a)k 



(/(n,a)fe) , 



for all < j < n — 1 and < k < Ua — 1, and hence 

1 



-^nZn,[n,a) 



—/= [ fo I fl-{n,a) I /2-(n,a) I " " ' I /(nQ-l)-(n,«) ] • 
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For /c = 0, 1, 2, . . . , riQ, — 1, we deduce 



f{n,a)k 



1 n-1 


2'Kijk ' 


n-1 








-j=o 




i=o 



and then, taking into account the equahties n = (n, a) ^^"^^ = (n,a)na, we can write 

1=0 

2na — 1 



where 



f{n,a)k 



2-Kikj 



27vikj 



2'Kikj 

e "a, 



{n,a)na — l 
j={(n,a)-l)na 



(21) 



2nikj 

e "a 



n„-l 





2irifc-0 


e 


"a 






e~ 


net 




2irife-2 



(22) 



According to formula (jlSp . one observes that the vector in (j22p is the k — th column of the 
Fourier matrix Fn^. Furthermore, for / = 0, 1, 2, . . . , (n, a) — 1, we find 



2'Kikj 



j=lna 





[- 27Tiklna n 




r 27rife-0 -1 






e "a 










27rzfc(ZncK +1) 




2irifc-l 




1 


e "Q 




e "Q 




2Tvik{lno:+2) 




2irifc-2 




2-Kikj 








e "a 




e 




27rifc (Zna+riQ — 1) 




2-Kik- {nc( — 1) 










e "Q 





i=o 



(23) 



Using (p3]) , the expression of the vector in ([2T]) becomes 



f{n,a)k 



2-nikj 

6 ^^f^ 



2'Kikj 

e "a 



2-Kikj 

e 



j=0 



> (re, a) times. 



Setting fr 
form 



2-Kirj 

e 



i=o 



(24) 



for < r < rea — 1, the Fourier matrix of size re^, takes the 



/o /i /2 • ■ ■ /n^-i 



(25) 
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From formula (j22p . the relation (j24p can be expressed as 





J k 


-) 




f{n,a)k 


fk 




> {n,a) 






. fk . 







(n, a) times, /c = 0, . . . , ria — 1, 



and, as a consequence, formula (jlOh can be rewritten as 





' /o 


f 


1 


/2 




fria — l 






/o 


f 


1 


/2 




fua-l 






. 7o 


f 


1 


h 


"7? 


fria — l - 






1 








"7? 

































1 



En 



Fr,. 



1 



F Z 



-J F Z 



□ 



In the subsequent subsection, we will exploit Lemma 13.31 in order to characterize the singular 
values of the a-circulant matrices Cn^a- Here we conclude the subsection with the following simple 
observations. 



and a 



(n,a) 



1; so the 



Remark 3.3. In Lemma \3.3l if (n, a) = a, we have = j^^^ = ^ 
matrix Zn^^a = Z^^^x, appearing in ( | j7[ ), is the identity matrix of dimension ^ x The relation 
p7|) becomes 



Fn.Zr) 



In. . ry Fn. 



The latter equation with a = 2 and even n appear (and is crucial) in the multigrid literature; 
see [21], equation (3.2), page 59 and, in slightly different form for the sine algebra of type I, see 
[8], Section 2.1. 
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Remark 3.4. // (n, a) = 1, Lemma \3.S\ is trivial, because Ha = ■^^^jy = n, a = -^^^jy = o, and so 
Zn,a = Zn^a- The relation (17) becomes 

— F Z 

since the matrix In,a reduces by its definition to the identity matrix of order n. 

Remark 3.5. Lemma HOI is true also if, instead of Fn and Fn^, we put F* and F*^, respectively, 
because F* = F^. In fact there is no transposition, but only conjugation. 

3.2 Characterization of the singular values of the a-circulant matrices 

Now we link the singular values of a-circulant matrices with the eigenvalues of its circulant coun- 
terpart Cn- This is nontrivial given the multiplicative relation Cn,a = CnZn,a- 

Having in mind the definition of the diagonal matrix Dn given in ((HI), we start by setting 

DlDn = dmg{\Dn\i s = 0,l,...,n-l) = diag(d,; s = 0, 1, • • • , n - 1) = A;, 

1=1 



(n,a) times 













lua 




lua 



















(n, a) times, (26) 



where 



A, 



d 



{«-l)no 



d{l-l)nc+l 



Dn defined in dlD, s = 0, 1, . . . , n - 1, (27) 
gC""^"- I = 1,2,..., {n,a), 



d 



{l~l)na+na-l 



J, 



{n,a) 



1 1 
1 1 



(n, a) times. 



(28) 



1 1 ••• 1 

We now exploit relation (jl2p and Lemma 13.31 and we obtain that 



FnZn,a — F^ 



Zn,a\Zn,a\ ' ' ' \ ZnA 



F Z \F Z \ ■ ■ - IF Z 



1 



1 
1 



\In,aFnaZnca\In,aFnc,Zna,a\ ' ' ' \In,aFnaZncCi\ 



n, a 



\In,a\In,a\ ' ' ' \ J-n,a_ 
\In,a\In,a\ ' ' ' \In,a\ {j{n,a) ® Fn^Zji.^ jy^ , 



Fua Zna,a 



F Z 



(n, a) times 



(29) 
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where I(n,a) is the identity matrix of order (n, a). Furthermore, 

— Z* F D*F*F D F*Z 

= {F*Zn,arD*^DnF*Zn,a- (30) 

From (j29p and (j26p . we plainly infer the following relations 

{F^Zn^a) = ; , - [^n,a|-^n,a| ' ' ' |-^ra,a] {j{n,a) ® Fj^^Z^^ a) ] 



^/{n,a) 
Y^(n,a) 

n,a) ® F^^Zji^^a) ■ 



Hence 



Cn,aCn,a = {l{n,a) ® Z*^,aFnc,) iJ{n,a) ® ^n^) 1 {J{n,a) ® In^,) {l{n,a) F*^Zn^^a) ■ 

( Til J 

Now using the properties of the tensorial product 

{I{n,a) ® Zl^,&FnJ{I{n,a) ® -^n„^n„,<i) 

~ I{n,a)I{n,a) ® ^na,a'^^a,a 
~ -^{n,a)-^{n,a) ® ^Ua ~ ^ni 

and from a similarity argument, one deduces that the eigenvalues of C* a^Cn,a are the eigenvalues 
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of the matrix 



I Til . (y. ) 







IrioL 






1 


lua 


IrioL 




In.a 


(n, q) 




























In a 


1 


lua 


Iria 




lua 


(n, a) 














Iria 




Iria 



A, 



A 



(n,a) 



Iria 


Iria 




Iria 


Iria 


Iria 




Iria 










. Iria 


Iria 




Iria . 



' Ai 


Al 




Al " 


A2 


A2 




A2 












A(„,q) 




A(n,Q) . 





(n,o) 

E A, 

1=1 


(n,a) 

E A, 

1=1 




{n,a) 

E A, 

1=1 


1 

(n, a) 


{n,a) 

1=1 


(n,a) 

E A, 

1=1 




(n,a) 

E A, 












(n,a) 

E A, 

L 1=1 


{n,a) 

E A, 

1=1 




(n,a) 

E A, 

1=1 



n, a 



1 1 
1 1 

1 1 




(n, a) times 

Therefore, from (1281). we infer that 



Eig(C*^„C„,„) = -Eig J(„_„) ^ A; 



where 



(n, a) 



Eig(J(„,«)) = {0,1}. 



(31) 



(32) 



Here we must observe that J{n,a) is a matrix of rank 1, so it has all eigenvalues equal to 
zero except one eigenvalue equal to 1. In fact note that the trace of a matrix is, by definition, 
the sum of its eigenvalues: in our case the trace is (n, a) ■ = 1 and hence the only nonzero 
eigenvalue is necessarily equal to 1. Moreover 



= X]^^^s(c^a-i)n„+j; i = 0, 1, . . . ,n„ - 1) 

1=1 1=1 

({n,a) 
^ d(i_i)n^+j; j = 0, 1, . . . , n„ - 1 
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(n,a) 

Consequently, since ^ A; is a diagonal matrix, we have 
1=1 

(n,a) "I 

^ j = 0, 1, . . . , na - 1 > , (33) 

. '=1 J 
where dk are defined in (i27|) . 

Finally, by exploiting basic properties of the tensor product, we know that the eigenvalues of a 
tensor product of two square matrices A® B are given by all possible products of eigenvalues of A 
of order p and of eigenvalues of B of order g, that is \{A B) = \j{A)\k[B) for j = 1, . . . ,p and 
k = 1, . . . ,q. Therefore, by taking into consideration (f3TI) . (f32]) . and (p3]l . we find 

^j{Cn,aCn,a) = X] ^{«-l)na+i ' J = 0, 1, . . . , - 1, (34) 
1=1 

^j{Cn,a.Cn,a) = 0, j =«„,..., 71 - 1. (35) 

From ([34ll , ([35]) and ([T]) , one obtains that the singular values of an a-circulant matrix Cn,a are 
given by 



(n,a) 

\ J = 0, 1,... ,na - 1, (36) 

\ 1=1 

CrjiCn,a) = 0, j = Ua,. ■ ■ ,n- 1, 

where the values dk, k = 0, . . . ,n — 1, are defined in (p7|) . 
3.3 Special cases and observations 

In this subsection we consider some special cases and we furnish a further link between the eigen- 
values of circulant matrices and the singular values of a-circulants. In the case where (n, a) = 1, 



we have = ^^^-^ = n. Hence the formula (j36p becomes 

crj{Cn,a) = y/d'j, j = 0, 1, . . . ,n - 1. 

In other words the singular values of Cn,a coincide with those of C„ (this is expected since Zn^a 
is a permutation matrix) and in particular with the moduli of the eigenvalues of C„. 

Concerning the eigenvalues of circulant matrices it should be observed that formula ^ can be 
interpreted in function terms as the evaluation of a polynomial at the grid points given by the n-th 
roots of the unity. This is a standard observation because the Fourier matrix is a special instance 
of the classical Vandermonde matrices when the knots are exactly all the n-th roots of the unity. 

Therefore, defining the polynomial p{t) = X]fc=o '^k^-^^^, it is trivial to observe that the eigenval- 
ues of Cn = FnDnF* are given by 



X^(Cn)=p(^^y i = 0. 



The question that naturally arises is how to connect the expression in (j36p of the nontrivial 
singular values of Cn,a with the polynomial p. The answer is somehow intriguing and can be resumed 
in the following formula which could be of interest in the multigrid community (see Section [5|) 
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In addition if a is fixed and a sequence of integers n is chosen so that (n, a) > 1 for n large 
enough, then {Cn,a} ~(t (0, G) for a proper set G. If the sequence of n is chosen so that n and a are 
coprime for all n large enough, then the existence of the distribution is related to the smoothness 
properties of a function / such that {a^} can be interpreted as the sequence of its Fourier coefficients 
(see e.g. |2Qj)- From the above reasoning it is clear that, if n is allowed to be vary among all the 
positive integer numbers, then {Gn,a} does not possess a joint singular value distribution. 



4 Singular values of a-Toeplitz matrices 

For p = q = d = 1, we recall that the a-Toeplitz matrices of dimension n x n are defined as 



where the quantities r — as are not reduced modulus n. In analogy with the case of a = 1, the 
elements aj are the Fourier coefficients of some function / in L^{Q), with Q = (— vr, vr), i.e., aj = fj 
as in @ with d = 1. If we denote by T„ the classical Toeplitz matrix generated by the function 
/ G L^{Q), Tn = [ar-c]"c=o! '^j = fj defined as in and by Tn^a the a-Toeplitz matrix generated 
by the same function, one verifies immediately for n and a generic that 



T IT 

J- n,a I -'n.a 



(39) 



where T„^a G (j^nx^jQ^ _ ^ matrix T„^q, defined in ([38|) by considering only the /i^ first 

columns, Tn^a G ([;;"x("-Mq) matrix Tn,a defined in ()38p by considering only the n — fia last 

columns, and Z„ „ is the matrix defined in (jlip by considering only the /i^ first columns. 



Proof, (of relation (f39l) .) For r = 0, 1, . . . , n — 1 and s = 0, 1, 

(^n,a)r,s 
(•^n,a)r,s 

and 



1, one has 



6r — n 



n-1 

'y^^iTn)r,liZn,a)l,s 

1=0 

n-1 



(a) 



1=0 

(2~n,a)r,; 



n JrA 



where (a) follows because there exists a unique / G {0, 1, . . . , n — 1} such that I — as = (mod n), 
that is, / = as (mod n), and, since < as < n — 1, we obtain / = as. □ 

If we take the matrix Tn^a of size n x (fj.^ + 1), then relation (I39p is no longer true. In reality, 
looking at the (^Uq, + l)-th column of the a-Toeplitz we observe Fourier coefficients with indices 
which are not present (less or equal to — n) in the Toeplitz matrix T„. More precisely, 



-afia ) 



and — a/iQ, < — n. 



It follows that Ha is the maximum number of columns for which relation (|39p is true. 
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4.1 Some preparatory results 

We begin with some preliminary notations and definitions. 

Definition 4.1. Suppose a sequence of matrices {j4„}„ of size dn is given. We say that {{-Bn,m}n '■ 
m > 0}, Bn,rn of sizc dn, m G N, is an approximating class of sequences (a.c.s.) for {An}n if, for 
all sufficiently large m G N, the following splitting holds: 



■^n — Bn „i + Rn,m ~\~ ^n,m for all n > Tim,) 



(40) 



with 

where \\ ■ \\ 
moreover, 



Raiik{Rn,rn) < dnc{m), \\Nn,m\\ < ^^im), (41) 
is the spectral norm (largest singular value), n^, c{m) and uj{m) depend only on m and, 



lim oj{m) = 0, lim c(m) 



0. 



(42) 



Proposition 4.1. |14j Let {dn}n be an increasing sequence of natural numbers. Suppose a sequence 
formed by matrices {An}n of size dn is given such that {{i?n,m}n : > 0}, m G N C N, #N = oo, 
is an a.c.s. for {An}n in the sense of Definition \4-l\ Suppose that {Bn,rn\n ~(7 {(^miG) and that 
6m converges in measure to the measurable function 9 over G. Then necessarily 



{^n}r 



(43) 



(see Definition\2, 



Proposition 4.2. [HIIIT] If {An}n and {Bn}n are two sequences of matrices of strictly increasing 
dimension, such that {An}n ~o- (^) G) and {Bn}n ~o- {0,G), then 



{An + Bn}n 



,G). 



Proposition 4.3. [Ti] Let f,g£ L^{Q'^), Q = (-7r,7r), and let {Tn{f)}n and {r„(g)}„ be the two 
sequences of Toeplitz matrices generated by f and g, respectively. The following distribution result 
is true 

{Tn{f)Tn{g)}n ~<x {fO^Q")- 

Lemma 4.1. Let f be a measurable complex-valued function on a set K, and consider the mea- 
surable function \/\f\ '■ K — > M"*". Let {An.ni\, with An^m 

g £dnxd'„^ d'^ < dn, be a sequence of 
matrices of strictly increasing dimension: d'^ < d^+i and dn < dn+i ■ If the sequence of matrices 
{A^^An^m}, with A'^^^An^m S C^"^*^" and d'^ < d^+i, is distributed in the singular value sense as 
the function f over a proper set G C K in the sense of Definition \2. 1\ then the sequence {An^m} is 
distributed in the singular value sense as the function \/\f \ over the same G. 



Proof. From the singular value decomposition [SVD)., we Ccin write fji 

An,m = uj:v* = u ■.. V*, 



0"2 
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with U and V unitary matrices U £ £dnxdn ^ y g £d'^xd'^ ^^^^ y, £ ^d^^d.'n^ (j- > O; by multiplying 



A* m^n.m we obtain: 



V 



4 



V* 



(44) 



with V unitary matrix V S C.'^'n^'^n 

and E M<x<, (j| > 0; we observe that (I44D is an SVD for 
A* ,^An^m, that is, the singular values crj{A'^ ^An^m) of A* ^An^m are the square of singular values 
o-i(^n,m) of ^n,m- Since {^* „^^„,m} (/, G), by definition it hold that for every F G Co(M^) 



1 



/.(G) 
1 

MG) 



G 



F(|/(t)|)dt 



i7 



G 



(45) 



where if is such that F = H o a/^; but, owing to (Tj{An^m) = y crj(^n,m^n,m) we obtain 

^ d'n ^ d'„ 



i=l 



Mm — S^H{ai{An^m)) 



dL 



(46) 



From (j45p and (j46p we obtain 



hm lgi/(a,(A„,„)) = ^ / ii 



(it. 



for every H G Co(MJ), so (ylTM, G). 



(47) 



□ 



Lemma 4.2. Let and {Qn}n be two sequences of matrices of strictly increasing dimension 

(An,Qn G £,d^xdn ^ < dn+i), where Qn are all unitary matrices (QnQn = V- If{^n}n ~cr (0,G) 

then {AnQn}n ~cr (0, G) and {Qn^njn ~<7 (0,G). 
Proof. Putting i?„ = AnQn, assuming that 

A — TT y V 

is an SVD for and taking into account that the product of two unitary matrices is still a 
unitary matrix, we deduce that the writing 

is an SVD for Bn- The latter implies that A^ and Bn have exactly the same singular values, so 
that the two sequences {>ln}n and {i?n}n are distributed in the same way. □ 
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Lemma 4.3. Let and {Qn}n be two sequences of matrices of strictly increasing dimension 

(An,Qn £ C'^"^'^'^ , dn < dn+i)- If {Art}n ~cr (0, G) and \\Qn\\ < M for some nonnegative constant 
M independent of n, then {AnQn}n ~(t (0, G) and {Qn^njn ~cr (0,G). 

Proof. Since {An}n ~(t (0,G), then {0„}n (sequence of zero matrices) is an a.c.s. for {An}n] this 
means (by Definition (j4.ip ) that we can write, for every m sufficiently large, m G N 

An = On -|- Rn,m (48) 

with 

Rank(/?„,m) < dnc{m), \\Nn,m\\ < uj{m), 
where Um > 0, c{m) and u){m) depend only on m and, moreover 

lim c(m) = 0, lim uj{m) = 0. 

m— >oo m— >oo 

Now consider the matrix AnQn\ from (j48|) we obtain 
with 

Rank(i?„,mQ„) < min{Rank(i?n_m), R.ank((5„)} < Rank(i?„,m) < dnc{m), 

\\Nn,mQn\\ < || A^n,m || || Qn || < Muj{m), 

where 

lim c{m) = 0, lim Muj{m) = 0, 

m^oo m^oo 

then {0„}n is an a.c.s. for the sequence {AnQn}n and, by Proposition 14. H {AnQn}n ~(t (0, G). □ 

4.2 Singular value distribution for the a-Toeplitz sequences 

As stated in formula (j39p . the matr ix Tn a can be written as 



Tn^n,a 



+ [ I T„,„ ] . (49) 



To find the distribution in the singular value sense of the sequence {Tn^a}n, the idea is to 
study separately the distribution of the two sequences {[r„Z„^Q,|0]}„ and {[0|7^^Q,]}n, to prove 
{[0|'7^,a]}n ~ (0, G), and then apply Proposition 14.21 



4.2.1 Singular value distribution for the sequence {[T„Z„a|0]}„ 

Since T„Z„ q, G C"^^° and [T^Zn^alO] G C"^", the matrix [T„Z„^q,|0] has n— /i^ singular values equal 
to zero and the remaining equal to those of T^Z^ to study the distribution in the singular value 
sense of this sequence of non-square matrices, we use Lemma 14.11 consider the a-Toeplitz matrix 
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"truncated" T„^q, = Tn{f)Zn,a, where the elements of the Toephtz matrix Tn{f) = [ar_c]"c=o 
the Fourier coefficients of a function / in L^{Q), Q = (— 7r,7r), then we have 

'^n,a^n,a — {Tn{f) Zn,a) T,fi{f)Zn^a — ■^n,a-^n(/) '^n{f) Zn,a 

= Z:^Ml)Tnif)Zn,a. (50) 

We provide in detail the analysis in the case where / G L'^{Q). The general setting in which 
/ G L^iQ) can be obtained by approximation and density arguments as done in |14j. From 
Proposition if / G L^{Q) C L^{Q) (that is l/p G L^{Q)), then {r„(7)T„(/)}„ ~, (|/P,Q). 
Consequently, for every m sufficiently large, m G N, the use of Proposition 14.11 implies 

r„(7)T„(/) = r„(|/|2) + R^:^ + Nn,m, Vn > nm, 

with 

Rank{Rn,m) < nc{m), ||A''n,m|| < uj{m), 
where nm > 0, c(m) and Lo{m) depend only on m and, moreover 



lim c(m) = 0, lim uj{m) = 0. 

m— >oo m— >oo 



Therefore (1501) becomes 



with 



Tn,a'^n,a — Z^^^[Tn{\f\'^)+Rn,rn~^Nn,rn)Zn,a 

— ^n,a^ni\f\ )-^n,a ~l~ Z^^^RYi YnZn,a ~\~ Zj^^^Nn,mZn,a 

~ ^n,a'^ni\f\'^)Zn,a~^Rn,m,a~^^n,m,a: (^1) 



Rank(i?„^m,Q) < min{Rank(Z„^Q,), Rank(i?„^m)} < Rank(i?„^m) < nc{m), (52) 

||^n,m,a|| < 2 1| || || iV„,m || < 2uj{m), (53) 



and 



lim c(m) = 0, lim 2Lj{m) = 0, 



where in ([52]) and (f53]) . = [-^n.olO] G C"^". In other words is the matrix Zn,a supple- 
mented by an appropriate number of zero columns in order to make it square. Furthermore, it is 
worth noticing that ||.^n,ci|| = ll-^noll = because Z^^a is a submatrix of the identity: we have 
used the latter relations in ([^5]) . 

Now, consider the matrix Z*^M\f\'^)Zn,a G C^"^^-, with /i„ = [|], / g L'^{Q) C L^{Q) (so 
l/P G L^iQ)). From ([39]), setting T„ = r„(|/|2) = [ar_c]";:io, with aj being the Fourier coefficients 
of l/p, and setting Tn^a the a-Toeplitz generated by the same function it is immediate to 
observe 

TnZn,a = ?n,a ^ ([^">^Mq^ with iTn^a)r,c = ^r-QO (54) 
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for r = 0, ... ,n - 1 and c = 0, . . . , fia - I- If we compute Z*^^Tn,a S C^°^^°, where Z*^^ = 
[6c-ar]rc=o i^k defined as in pT|) ) and Z* q, G C''"^" is the submatrix of Z*^^ obtained by consid- 
ering only the //q first rows, for r, c = 0, . . . , //q, — 1, we obtain 

{^n,a^n{\f\ )Zn,a)r,c — {Zn^a'^n,a)r,c 

n~l 

— (^ra,a)ar,c 
(a) 

, . (^ar—acj 
from ||54| | 

where (a) follows from the existence of a unique i G {0, 1, . . . , n — 1} such that i — ar = (mod n), 
that is, £ = ar (mod n), and, since < ar < n — 1, we find £ = ar. 
Therefore 

^n,a^n{\f\ )Zn^a = [Q'or-ac]r^c=0 

where |/|(^) G L^iQ) is given by 

l7^(x) = -El/Pf^^), (55) 



hoo 



|/|2(x) = Yl (56) 



fc=— oo 



Proof, (of relation ()55|) .) We denote by aj the Fourier coefficients of |/|(-^). We want to show that 
for r, c = 0, . . . Ok are the Fourier coefficients of From (jH), ([55]) 



and (ESI), we have 



^ " i=0 fc=-oo 



k=—oo \j=0 



Some remarks are in order: 



" 1 i2Trkj '^L^ i2natj 



if /c is a multiple of a, k = at for some value of t, then we have that ^ " ~ ^ ° 

j=o j=o 

a—l a—1 

j2 e'2^*i = ^ 1 = a. 

if K is not a multiple of a, then e « 7^1 and therefore 2^ e ^ = [e ^ j is a finite 
geometric series whose sum is given by 

E/ i22^y _l-ec, - e*^'^'^ _ 1-1 _ 

I ^ ° ) a^rfc i27rfc i27rfc ^• 

j=o 1 — ea \ — e a 1 — e a 
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Finally, taking into account the latter statements and recalling that ^ e^^^dx = { J otherwise ' 
we find 

+00 



+00 „^ 



t= — 00 



□ 

In summary, from (I5ip we have 

ra a i^:Oi — '^fJ.ot ( I / I ) ~l~ Rn,m,a ~l" ^n,m,aj 

with {r^„(|7|(2))}n ~<7 (|7|(2),Q). We recall that, owing to §5i), the relation |/p E Li(Q) implies 
G Consequently Proposition O implies that {f^_^f„,c.}n ~a Clearly 



|/|(^) G L^iQ) is equivalent to write \/|/|^'^^ G L^{Q): therefore, from Lemma I4.H we infer 



{Tn,a}n ~<x (VI/I^'^Q)- 

Now, as mentioned at the beginning of this section, by Definition l2.lt we have 

lim - VF((T,([f„,„|0])) = lim - VF(aj([f;.„|0])) + hm - V F(0) 



n^oo n Lin n^oo n 



1 1 

a 2iT 



which results to be equivalent to the following distribution formula 

{[T„Z„,,|O]}„~<,(0,Qx [0,1]), (57) 

where 



e{x,t) = \ VI/I^'H^) forte [0,ij, (58) 
4.2.2 Singular value distribution for the sequence {[0|7^q,]}„ 

In perfect analogy with the case of the matrix [T„Z„_q|0], we can observe that Tn^a G (^'n■x{n-^^a) 
and [0|7^^Q,] € C"^". Therefore the matrix [0|7^^q,] has singular values equal to zero and the 
remaining n — fi^ equal to those of T^^q,. However, in this case we have additional difficulties 
with respect to the matrix Tn^a = TnZn^a, because it is not always true that Tn^a can be written 
as TnZn^a, where Zn,a is the matrix obtained by considering the n — fia last columns of Zn^a- 
Indeed, in 7^^^ there are Fourier coefficients with index, in modulus, greater than n: the Toeplitz 
matrix T„ = [ar-c]"c=o coefficients aj with j ranging from 1 — n to n — 1, while the a-Toeplitz 
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matrix Tn^a = [ar-ac]"c=o as coefficient of maximum index and o_q(„_i) as coefficient of 

minimum index, and, if a > 2, we have — a(n — 1) < — (n — 1). 

Even if we take the Toeplitz matrix T„, which has as its first column the first column of 
Tn^a and the other generated according to the rule {Tn)j^k = t^j-fc) it is not always true that 
we can write T^^q, = T^P for a suitable submatrix P of a permutation matrix, indeed, if the 
matrix = [/3r-c]"c=o ^ ^'■^^ column the first column of 7^,q,, we find that I3q = (7^^, 



{Tn,a)o,iJ.^ = a-a/ic- ^s a conscquence, r„ has = a_(„_i)_a^^ 

index, while Tn^a has a-a{n-i) as coefficient of minimum index. Therefore 

— (n — 1)q — (— (n — 1) — O/Uq) 



a)o,o — 

as coefficient of minimum 



= (1- 


a)(n 


— 1) + afia n < 


< (1- 


a){n 


- 1) + (n + a - 1) 


= (1- 


a){n 


- 1) + (n- 1) +a 


= (n — 




— a + 1) + a 


= (2- 


a)(n 


- 1) + a < for 



< (n + a- 1) 



Thus, if a > 2 and n > 4 we have — (n — 1)q < — (n — 1) — q^Uq and the coefficient of minimum 
index a_Q,(„_i) of Tn^a is not contained in the matrix T„ that has a„(„_i)_Q^^ as coefficient of 
minimum index. 

Then we proceed in another way: in the first column of Tn^a G ([;;"x("--Ma) (and consequently 
throughout the matrix) there are only coefficients with index < 0, indeed coefficient with the largest 
index of Tn^a is i%,,a)n-i,o = (Tn,a)n-i,^ia = On-i-QMa and n - 1 - a^a <n-l-n<0 and the 
coefficient with smallest index is ('7n,a)o,n— /ta— i = ,Q:)o,n— 1 a(n— 1)* 

Consider therefore a Toeplitz matrix T^^ ^ of dimension dn^a with dn.a > "^"2'^^ ~^ defined in this 



way: 



ao 



a_2 



a_2 



[a 



r c=0 



(59) 



Since the coefficient with smallest index is a_2dna+2^ we find 

' ain — 1) 



+ 1 + 2 = -a(n - 1) - 2 + 2 = -a{n - 1). 



-2d„,c. + 2 < -2 



As a consequence, we obtain that all the coefficients of T^^q, are "contained" in the matrix T^^ ^ . 
In particular, if 

dn,a > (a - l)(n- 1) + 2, 
(this condition ensures dn^a > "^"2 + ^^^^ subsequent inequalities are correct, and that 



the size of all the matrices involved are non- negative) , then it can be shown that 



(60) 



where Z^^ ^ {[^d,n,ay-{n fj.a) ^j^g matrix defined in (llip . of dimension dn.a x dn^a, by considering 
only the n- Ha first columns and [0i|I„|02] G C"^''"'" is a block matrix with Oi G £nx{dn,c.-atj.c,-i) 
and O2 G C'^xCa/^^-'^+i). 
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Proof, (of relation (j60p .) First we observe that: 

for r = 0, 1, . . . , n — 1 and s = 0, 1, . . . , n — /i^ — 1 we have 

for r = 0, 1, . . . , n — 1 and s = 0, 1, . . . , dn^a — 1 we have 



( [Ol I In I O2]). 



1 if S = r + dn^a — Ctfla — 1, 

otherwise; 



(61) 



(62) 



for r, s = 0, 1, . . . , dn^a — 1 we have 

i'^dn^a)r,S = O-r-S-dn.a + l'l 

for r = 0, 1, . . . , dn^Q — 1 and s = 0, 1, . . . , n — — 1, we have 

(,^dn.a,a)r,s — ^r—as- 



Since Td„^^Zd„,^,a e C'^".-x("-^"), for r = 0, 1, . . . , dn,a - 1 and s = 0, 1, . . . , n - - 1, it holds 

dn,a 1 

1 = 

dn , a 1 

1=0 

= ar-as-d„,c+l) (63) 
(a) 

where (a) follows from the existence of a unique / G {0,1,... ,dn,a — 1} such that I — as = 
(mod dn,a), that is, I = as (mod dn^a), and, since < as < dn,a — 1, we have / = as. Since 
[Oil/nlOa] Trf„ E c^x^"-/^"), for r = 0, 1, . . . , n - 1 and s = o', 1, . . . , n - Ma - 1, we find 



([0l|/„|02] Td„.c2:d„.c,a) 



(d) 



from inn 



1=0 

(^r+dn^a-af^a-^-as 

a. 



-1 



r—afia —as 



where (d) follows from ([631), (Td„^^Zd„^^,a)i,s = a/-Qs-d„,c+i, and from the following fact: using 
(f62]l . we find ([0i|/„|02])r,« = 1 if and only if / = r + — a/i^ — 1- □ 



We can now observe immediately that the matrix T^^ ^ defined in (|59p can be written as 

Td^,. = JHd^.., (64) 
where J is the "flip" matrix of dimension dn,a x dn,a- 

1 



J 



1 
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and Hci^ ^ is the Hankel matrix of dimension dn,a x dn,oi'- 

a-2 



ao 



a_i 

a-2 



CL—rl -1-1 fl— r/ —1 



If f{x) G L^((5), Q = (— 7r,7r), is the generating function of the Toephtz matrix T„ = Tn{f) 



]n— 1 
''r-c\rr=0 



in ()39p . where the fc-th Fourier coefficient of / is a^, then f{—x) G is the generating 

^; by invoking Theorem 6, page 161 of [7], 



function of the Hankel matrix H, 



-r-c\r,c=0 



the sequence of matrices {Hd^^} is distributed in the singular value sense as the zero function: 
{^dn q} (0) Q)- From Lemma|121 by since J is a unitary matrix, we have {T^^ ^} ~o- (0, Q) 
as well. 

Consider the decomposition in (j60p : 



'?n,« = [0l|/n|02] „2^d„ 



If we complete the matrices Qd„ „ G C 



?T. X d , cv 



and Zd^^^^a G 



-'d„,QX(n-/iQ,) 



by adding an appro- 



priate number of zero rows and columns, respectively, in order to make it square 

.a. 



Q 



dn,a 



then it is immediate to note that 



Qd„ 









[ 1 




" 









G 



G C 



From LemmaHSl since ||Q(i„,„|| = HZ^^^^qH = 1 (indeed they are both "incomplete" permuta- 
tion matrices), and since {Td„^} ~o- (0,(5), we infer that {Tn,a} ~ct (0,(5)- 

Recall that Tn,a £ C'^"-"^'^"'" with dn,a > (a - l)(n - 1) -|- 2; then we can always choose dn,a 
such that an = dn,a > (a — l)(n — 1) -|- 2 (if n,a > 2). Now, since {Tn,a} ~(t (0, Q), it holds that 
the sequence {T^^q,} is weakly clustered at zero in the singular value sense, i.e., Ve > 0, 



tj{j : aj{Tn,a) > e} = o{dn,a) = o{an) = o{n). 
The matrix T„ „ is a block matrix that can be written as 



(65) 



- n,a 





■ 






" 

















where Tn,a S C""^^" ^"'^ and [7^^q,|0] G C"^". By the singular value decomposition we obtain 





■ 



























[720^2* 







U2 \ 



Si 


■ 




r Vi 





* 













V2 \ 





that is, the singular values of Tn,a that are different from zero are the singular values of [T^^^lO] G 
(j-<nxn^ Thus (165p can be written as follows: Ve > 0, 

JJ{i : (jj([T„_Q,|0]) > e} = o{dn,a) = o{an) = o{n). 
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The latter relation means that the sequence {['7^,a|0]}„ is weakly clustered at zero in the singular 
value sense, and hence {['?^,a|0]}ri ~(j {0,Q). If we now consider the matrix 



G = 















where In-Ha is the identity matrix of dimension (n — ^a) x (n — ^q), then [T^^alOjG = [0|7^,q,], and 
since ||G|| = 1 and {['7^,a|0]}„ ~(j (0,Q), from Lemma we find 

{[0|T„,,]}„~„(0,g). (66) 

In conclusion: from the relations ()49p . ()57p and (I66p . using Proposition 14.21 with G = Q x [0, 1], 
we obtain that 

{Tn,a}n ~a (0, Q X [0,1]), 

where is defined in (|58p . Notice that for a = 1 the symbol 6{x,t) coincides with l/K^) on the 
extended domain Q x [0,1]. Hence the Szego-Tilli-Tyrtyshnikov-Zamarashkin result is found as a 
particular case. Indeed 9{x,t) = |/|(2;) does not depend on t and therefore this additional variable 
can be suppressed i.e. {Tn^a}n ~a- (/, Q) with T^^a = Tn{f). The fact that the distribution formula 
is not unique should not surprise since this phenomenon is inherent to the measure theory because 
any measure-preserving exchange function is a distribution function if one representative of the 
class is. 



5 Some remarks on multigrid methods 

In the design of multigrid methods for large positive definite linear systems one of the key points 
is to maintain the structure (if any) of the original matrix in the lower levels. This means that 
at every recursion level the new projected linear system should retain the main properties of the 
original matrix (e.g. handedness, the same level of conditioning, the same algebra/Toeplitz/graph 
structure etc.). Here for the sake of simplicity the example that has to be considered is the one- level 
circulant case. Following [ll[2T]) if = Cn is a positive circulant matrix of size n with n power of 
2, then the projected matrix Ak with k = n/2 is defined as 

■^k = Z'^^2Pn^nPnZn,2i (67) 

where Pn is an additional circulant matrix. It is worth noticing that the structure is kept since for 
every circulant Pn the matrix Ak is a circulant matrix of size k = n/2. The features of the specific 
Pn have to be designed in such a way that the convergence speed of the related multigrid is as high 
as possible (see [9l[l] for a general strategy). We observe that the eigenvalues of A^ are given by 

l^/x^+2vr/\ = ,- = o,l,...,fc-l, fc = n/2, (68) 

where g is the polynomial associated with the circulant matrix P*AnPn in the sense of Subsection 
13.31 Therefore the sing ular values of {P*AnPnY''^ Zn,2 are given by 



^/x^+2vr/\ ^.^o,l,...,fc-l, ^ = n/2. (69) 
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Notice that the latter formula is a special instance of (j37p for |pp = g {g is necessarily non- 
negative since it can be written a \q\^ f where q is the polynomial associated with P„ and / the 
nonnegative polynomial associated with for a = 2 and n even number so that (ra, 2) = 2. 
Therefore, according to (|37|) . the numbers in (|69|) identify the nontrivial singular values of the 2- 
circulant matrix (P* A„P„)^/^Z„^2 up to a scaling factor. In other words a-circulant matrices arise 
naturally in the design of fast multigrid solvers for circulant linear systems and, along the same 
lines, a-Toeplitz matrices arise naturally in the design of fast multigrid solvers for Toeplitz linear 
systems; see [9| fH [TS]. 

Conversely, we now can see clearly that formula (j37p furnishes a wide generalization of the 
spectral analysis of the projected matrices, by allowing a higher degree of freedom: we can choose 
n divisible by a with a 7^ 2, we can choose n not divisible by a. Such a degree of freedom is not 
just academic, but could be exploited for devising optimally convergent multigrid solvers also in 
critical cases emphasized e.g. in [HHS]- In particular, if xq is an isolated zero of / (the nonnegative 
polynomial related to = Cn) and also tt + xq is a zero for the same function, then due to special 
symmetries, the associated multigrid (or even two-grid) method cannot be optimal. In other words, 
for reaching a preassigned accuracy, we cannot expect a number of iterations independent of the 
order n. However these pathological symmetries are due to the choice of a = 2, so that a choice of 
a projector as PnZn,a for a different a / 2 and a different n could completely overcome the latter 
drawback. 



6 Generalizations 

First of all we observe that the requirement that the symbol / is square integrable can be removed. 
In [13] it is proven that the singular value distribution of {T„,(/)T„((7)}„ is given hy h = fg with 
f,g being just Lebesgue integrable and with h that is only measurable and therefore may fail to 
be Lebesgue integrable. This fact is sufficient for extending the proof of the relation {T„^q,}„ ~o- 
{9, Q X [0, 1]) to the case where 6{x, t) is defined as in ([58]) with the original symbol f £ L^. 
Now we consider the general multilevel case. When a is a positive vector, we have 

{Tn,a}n-a{e,Q'' X[0,1]''), (70) 

where 

9{x,t) = i /PH^ forte[0,i- 
[ forte(i,e 

with 

l7P(x) = -El/P(^^^), (72) 

and where all the arguments are modulus 27r and all the operations are intended componentwise 
that is i G [O, ^] means that tk G [0, l/a^], k = 1, . . . ,d, t £ (^, e] means that tk G (l/ctfc) 1]) ^ = 
1, . . . , d, the writing defines the d-dimensional vector whose k-th component is {xj+2Trjk)/c(k, 

k = 1, . . . ,d, and a = aia2 ■ ■ ■ dd- 

6.0.3 Examples of a-circulant and a- Toeplitz matrices when some of the entries of a 
vanish 

We start this subsection with a brief digression on multilevel matrices. A d-level matrix A of 
dimension h x h with n = (ni, n2, . . . , n^) and n = nin2 • • • can be viewed as a matrix of 



(71) 
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dimension ni x rii in which each element is a block of dimension n2n3 ■ ■ ■ rid x n2ns ■ ■ ■ n^; in turn, 
each block of dimension n2?^3 • • • re^ x n2ns ■ ■ - n-d can be viewed as a matrix of dimension n2 x n2 
in which each element is a block of dimension nsn^ ■ ■ - Ud x n3n4 • • • Ud, and so on. So we can say 
that rii is the most "outer" dimension of the matrix A and is the most "inner" dimension. If 
we multiply by an appropriate permutation matrix P the d-level matrix A, we can exchange the 
"order of dimensions" of A, namely P^AP becomes a matrix again of dimension n x h but with 
= ('^p(i) ) '^p(2) ) • • • ) ^p{d)) ^ = '^p(i)™p(2) ■ ■ ■ ^p{d) = n'in2 ■ ■ - Ud (where p is a permutation of d 
elements) and np(i) is the most "outer" dimension of the matrix A and np(^) is the most "inner" 
dimension. 

This trick helps us to understand what happens to the singular values of a-circulant and a- 
Toeplitz d-level matrices, especially when some of the entries of the vector a are zero; indeed, 
as we observed in Subsection 12.1.21 if a = 0, the d-level a-circulant (or a-Toeplitz) matrix A is 
a block matrix with constant blocks on each row, so if we order the vector a (which has some 
components equal to zero) so that the components equal to zero are in the top positions, a = 
(0, . . . , 0, Ofc) • • • ) otd), the matrix P^AP (where P is the permutation matrix associated with p) 
becomes a block matrix with constant blocks on each row and with blocks of dimension ■ ■ ■ rid x 
nk' ' ' rid', with this "new" structure, formulas ([8]) and ([9]) are even more intuitively understandable, 
as we shall see later in the examples. 

Lemma 6.1. Let A he a 2-level Toeplitz matrix of dimension fixfi with n = (ni, 722) and fi = nin2, 

n\ — l 



A 



["(jl-fel j2-fc2)J j2,fc2=0 



Jl,fci=0 



There exists a permutation matrix P such that 



P^ AP 



[0(jl-fcl„ 



1 ni— 1 



J2-fe2)J ji,fci=0 



n2-l 
j2,k2=0 



Example: Let n = (ni, 71-2) = (2, 3) and consider the 2-level Toeplitz matrix A of dimension 6x6 



A 



' "(0,0) 


0(0,-1) 


0(0,-2) 


"(-1,0) 


"(-1,-1) 


"(-1,-2) 


"(0,1) 


0(0,0) 


0(0,-1) 


"(-1,1) 


"(-1,0) 


"(-1,-1) 


"(0,2) 


0(0,1) 


0(0,0) 


"(-1,2) 


"(-1,1) 


"(-1,0) 


"(1,0) 


"(1,-1) 


"(1,-2) 


0(0,0) 


0(0,-1) 


0(0,-2) 


0(1,1) 


"(1,0) 


"(1,-1) 


"(0,1) 


0(0,0) 


0(0,-1) 


- "(1,2) 


"(1,1) 


0(1,0) 


"(0,2) 


"(0,1) 


"(0,0) - 



This matrix can be viewed as a matrix of dimension 2 x 2 in which each element is a block 
of dimension 3x3. If we take the permutation matrix 



P = 



1 























1 























1 








1 























1 























1 
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then it is plain to see that 







( — 1,0) 


(0,-1) 


"(-1,-1) 


(0,-2) 


"(-1,-2) 








"d -11 


"fO -1") 


(^{1 -21 


"fO -21 


AP = 






O('o n't 


flf — 1 0"! 




Q^C— 1 —1") 




"(1,1) 


"(0,1) 


"(1,0) 


"(0,0) 


"(1,-1) 


"(0,-11 




"(0,2) 


"(-1,2) 


"(0,1) 


"(-1,1) 


"(0,0) 


"(-1,01 




- "(1,2) 


"(0,2) 


"(1,1) 


"(0,1) 


"(1,0) 


"(0,01 - 



and now P^ AP can be naturahy viewed as a matrix of dimension 3 x 3 in which each element 
is a block of dimension 2x2. 

Corollary 6.1. Let A be a d-level Toeplitz matrix of dimension fi x h with n = (ni,n2, • • • ,nrf) 
and h = nin2 • • • Ud, 

n\ — l 

•• ["(ii- 



A 



i"d-i 

-ki,j2-k2,--;jd-kd)l jrf,fed=0 ■ 



n2 — 1 
j2,k2=0 



jl,fci=0 



For every permutation p of d elements, there exists a permutation matrix P such that 



P^ AP 



["(il-fcl,j2-fc2,---,jd-fcd). 



"p(d)-J- 
ip(d),'=p(d)=0 



np(2)-i 
jp(2),kp(2)=0. 



"■P(l)-1 

ip(i),fcp(i)=o 



Remark 6.1. Lemma \6.1\ and Corollary \6.1\ also apply to d-level a-circulant and a-Toeplitz ma- 
trices. 

Now, let a = {ai,a2, ■ ■ ■ ,ad) be a d-dimensional vector of nonnegative integers and t = 
tt{j : Oj = 0} be the number of zero entries of a. If we take a permutation p ol d elements 



such that a. 



•p(i) = ap(2) 



a. 



0, (that is, p is a permutation that moves all the 



zero components of the vector a in the top positions), then it is easy to prove that formulas 
dS]) and ([9]) remain the same for the matrix P^ AP (where P is the permutation matrix asso- 
ciated with p) but with n[0] = (?i.p(i), 'rap(2), • • • , np(t)) and where Cj and Tj are a d"'"-level a"*"- 
circulant and a^-Toeplitz matrix, respectively, with a+ = (ap((_|_i), ap(t_|_2)) • • • i ctp(d))) of partial 
sizes n[> 0] = (?^p(t+i) , 'rap((^2) i • • • j^p(d))^ ^^'^ whose expressions are 



(r— aos) modn_ 



'"p(d),'5p(d)=0 



^p(t+2)- 



['^(■r— aos)] 



np(d)-l 
^'-"°'')JMd),^P(d)=0 



^p(t+2),«p(t+2)=0 
1 





"p(t+2) 

'^p(t+2),«p(t+2) 



p(t+l),^*p(t+l) = 
"p(t+l)-l 



^p(t+l),''p(t+l) 

j. Obviously Sgval(.4) = Sgval(P^^P). 



=0 



with (rp(i),rp(2), . . ■,rp^t)) 

We recall that if i? is a matrix of size nx n positive semidefinite, that is B* = B and x*Bx > 
Vx 7^ 0, then Eig(i?) = Sgval(-B). Moreover, if B = UT,U* is a SVD for i? (which coincides with 
the Schur decomposition of B) with S = diag^ (o'i)) then 

where S^/^ = diag (^/oT). 

d=l,....n ^ V J ' 
with two detailed examples: a 3-level a-circulant matrix with a = [ai,a2,a3) = 

(1,2,0), and a 3-level a-Toeplitz with a = (01,02,03) = (0,1,2), which helps us to understand 

what happens if the vector a is not strictly positive. Finally we will propose the explicit calculation 

of the singular values of a d-level a-circulant matrix in the particular case where the vector a has 

only one component different from zero. 
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Example: Consider a 3-level a-circulant matrix A where a = (qi, 02)03) = (1)2,0) 



A 



r -\n3-l 
[ {{ri—l-si) mod ni,{r2— 2-S2) mod n2,(r3— O-sa) mod 713) J ^.^^^g—Q 



["{(ri-si 



-ina-l 

) mod ni,(r2-2s2) mod n2,»"3)Jr3=0 



ri2 — 1 
f'2,S2=0 



S3 = 
ni — 1 

ri,si=0 



112 — 1 
»"2,S2=0 



ni — 1 
ri,si=0 



If we choose a permutation p of 3 elements such that 



(p(l),p(2),p(3)) = (3,2,1), 

(Op(l))«p(2))«p(3)) = (0)2,1), 

(np(i),np(2))np(3)) = (n3,n2,ni), 
and if we take the permutation matrix P related to p, then 



P'^AP = A 



1 ?ii — 1 



-'■(('•l-si) mod ni,(r2-2s2) mod n2,r3)J ri,si=0 

Now, for r3 = 0, 1, ■.■,n^ — 1, let us set 



712 — 1 
r2,S2=0 



-| J13-1 
r3=0 



a 



[^((ri-si 



1 ni— 1 



) mod ni,(r-2-2s2) mod n2,r3)J .,j^_g 



T12 — 1 
r2,S2=0 



As a consequence, Cr-^ is a 2-level a"'"-circulant matrix with = (2, 1) and of partial sizes 
n[> 0] = (n2,ni) and the matrix A can be rewritten as 



A 



Co Co 
Ci Ci 



Co 
Ci 



Cn-^ — \ (7^3 — 1 ■ ■ ■ Cn3 — 1 

and this is a block matrix with constant blocks on each row. From formula ([T|), the singular 



30 



values of A are the square root of the eigenvalues of A* A: 



A*A 



Co* CI 
C* CI 



Co* CI ■ 

ns-l 

E c*c, 
E qc, 

j=0 



^"3-1 
•-^"3-1 



■■ '-""3-1 

na-l 

"3-1 

J=0 



Co 
Ci 



Co 
Ci 



"3—1 "3-1 

E c*c, E c*c, 

1 1 ••• 1 
1 1 • 



Cng — 1 Cn3 — 1 

"3-1 

E c*c, 

i=o 

"3-1 

E c]c, 

j=0 



"3 — 1 

E c;c, 

j=0 



■ Co 
• Ci 

Crig _ 1 



1 1 



"3 — 1 

i=o 



n3 times 

"3 — 1 



5]c;c,. 

j=0 



Therefore 



where 



"3-1 



Eig(i*i) = Eig [jm^Yl ^J^i 1 ' 



Eig(J„3) = {0,713}, 



(74) 



(75) 



because J„3 is a matrix of rank 1, so it has all eigenvalues equal to zero except one eigenvalue 
equal to tr(J„3) = 713 (tr is the trace of a matrix). If we put 




by exploiting basic properties of the tensor product and taking into consideration ()74p and 
rSl) we find 



Xk{A*A) = n^Xk, k = 0, . . . ,nin2 - 1, 
Xk{A*A) = 0, k = nin2, ■ ■ ■ ,nin2n3 — 1. 



(76) 
(77) 



From ([76|) . ([77|) and ([T]), and recalling that Sgval(^) = Sgva^A), one obtains that the singular 
values of A are given by 



crfc(A) = y/n^Xk, k = 0, . . . ,nin2 - 1, 
akiA) = 0, k = nin2, . . . ,nin2n3 - 1, 
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ng-l 

and, since Yl ^j^j ^ positive semidefinite matrix, from (j73p we can write 

o-fc(^) = Vm^k, A; = 0, . . . ,nin2 - 1, 
akiA) = 0, k = nin2,...,nin2ns-l, 

(\ 1/2 
^ C*Cj 
j=o J 

Regarding the distribution in the sense of singular values, let F G Co(M[J"), continuous function 
over M.Q with bounded support, then there exists a G M"*" such that 

< a Vx G M(^. (78) 



From formula ([2]) we have 

^ nin2n:j — l 



According to ([78]) . we find 



Therefore 



so that 



nin2(n3 - l)F(O) 1 "^^'^^ . 
\ > ^ F{y/ri3ak) 

A;=0 

/ \ nin2-l 



711712 — 1 

-anin2 < ^ F{y/n^ak) < anin2. 
k=o 



^ ni?i2-l 

— < Fi^ak) < — , 

k=0 



1 _ L) F{0) --< E.(F,^„) < fl - F{0) + -. 

Now, recalling that the writing n — > oo means mini<j<3 rij oo, we obtain 

F(0) < limS,(F,yl„) <F(0), 

n— >oo 

which implies 

lim = F(0). 

71— »00 

Whence 

{A^} ~. (0,G), 

for any domain G satisfying the requirements of Definition 12.11 
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Example: Consider a 3-level a-Toeplitz matrix A where a = (ai, 02, as) = (0, 1, 2) 



A 



r in-j-l 
["'{ri-0-si,r2-l-S2,r3-2-S3)\ ^3,53=0 



^(ri,r2—S2,r3—2s3) 



1 "3-1 
r3,S3=0, 



712 — 1 
r2,S2=0 



n2 — l 

r2,S2=0 
-| ni — 1 

ri=0 



Til —1 



ri,si=0 



The procedure is the same as in the previous example of an a-circulant matrix, but in this 
case we do not need to permute the vector a since the only component equal to zero is already 
in first position. For ri = 0, 1, ni — 1, let us set 

n2 — 1 
r2,S2=0 



[«(n 



] "3-1 
,r2-S2,r3-2s3)J^3^g3=0 



then is a 2-level a^-Toeplitz matrix with a+ = (1, 2) and of partial sizes n[> 0] = (n2, na) 
and 



A 



To To 
Ti Ti 

Tni — l Ti2i — 



To 
Ti 

T 



The latter is a block matrix with constant blocks on each row. From formula ([T]), the singular 
values of A are the square root of the eigenvalues of A* A: 



A*A 



ni — 1 



ni — 1 



T. 



ni — 1 



To 
Ti 



To 
Ti 



ni — 1 



j=0 j=0 



ni— 1 



ni — 1 



j=0 



j=0 



ni— 1 ni— 1 



Tfii — l ^ni — 1 
ni — 1 

i=o 

rii — 1 

i=o 



ni — 1 



To 

^ni-l 



j=0 
1 1 
1 1 

1 1 



1 
1 



j=0 



ni — l 

^^T*T, 

j=0 



III times 
ni — 1 



j=0 



Therefore 



ni — 1 



Eig(A*yl) = Eig I J„,® J] T/T,- I , 

j=0 



(79) 
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where 

Eig(J,J = {0,ni}, (80) 

because is a matrix of rank 1, so it has all eigenvalues equal to zero except one eigenvalue 
equal to tr(J„^) = ni (tr is the trace of a matrix). If we put 

Afc = Afc ^ TjTj , k = 0,..., nzn2 - 1, 

by exploiting basic properties of the tensor product and taking into consideration ([75]) and 
(IHO]) we find 

\k{A*A) = niAfc, /c = 0, . . . ,n3n2 - 1, (81) 
\k{A*A) = 0, k = n3n2, . . . , n3n2ni - 1. (82) 

From ([HT]) . ([82]) and ([T]), one obtains that the singular values of A are given by 



ak{A) = yJniXk, k = 0,..., n^n2 - 1, (83) 

ak{A) = 0, k = n3n2, nzn2ni - 1. (84) 

n\ — l 

and, since ^ 2^7*^j is a positive semidefinite matrix, from (j73p we can write 
i=o 

CTfc(A) = ^/nlafc, = 0, ... ,713712 - 1, 

Crfe(^) = 0, A; = 77,3712, ... ,713712711 - 1, 

(\ 1/2 
j=o J 

Regarding the distribution in the sense of singular values, by invoking exactly the same 
argument as in the above example for a-circulant matrix, we deduce that 

{An} ~. (0,G), 

for any domain G satisfying the requirements of Definition 12.11 

Example: Let us see what happens when the vector a has only one component different from zero. 
Let n = (rii, ?i2, • • • , n^) and a = (0, . . . , 0, a^, 0, . . . , 0), > 0; in this case we can give an 
explicit formula for the singular values of the d-level a-circulant matrix. For convenience and 
without loss of generality we take a = (0, . . . , 0, Od) (with all zero components in top positions, 
otherwise we use a permutation). From [27L3l the singular values of An = [a(r-aos) mod n]r7=o 
are zero except for few of them given by Y^n[0](j where, in our case, n[0] = nin2 • • -rid-i, 
n[0] = (7ii, 772, • • • ) n-d-i), and a is any singular value of the matrix 

^ 1/2 

j=0 
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where Cj is an a^-circulant matrix of dimension x n^^ whose expression is 



i \P'{r—aos) modnj, 



'"<i,Sd=0 



]"d-l 

"{ri,r2,...,r^_i,(rd-«dSd) mod n^) J ,-^,5^=0 
1 rid-l 

at 



KJXrd-adSd) modnd)\r^^sd=0 ' 

with (ri, r2, . . . , r-^^-i) = j. For j = 0, . . . , n[0] — e, if Cn''^^ is the circulant matrix which has as 
its first column the vector a^^^ = [«(j,o)i • • • > "(i.^d-i)]"^ (which is the first column of the 
matrix Cj), ci^] = [a(j,(r_s) mod nd)]"s=o = ^ridDn^F*^, with L>i^] = diag{.yn2F*^a^^'^), then, 
from (|3U|) . pU|) . and p6|) . it is immediate to verify that 



EC*C- = \^ (F D^^^F* Z )*(F D^^^F* Z ) 
] 3 rid-^Ud^ nd^''^d,ad) \^ nd^Ud nd^nd,adJ 

j=0 j=0 
n[0]-e 

/n[0]-e \ 
iKdZnd,adr I E (^n*,^n„.J 



Now, if we put rid^c 



nd 



{nd,ad) 



and 



„(j) _ |n{i)|2 —(r){j)\ .(T-) 
Is — \-'^nd\s,s — K-'^nd )s,s 



rid )s,s-, 



s = 0,1, ... ,nd - 1, 



j=0 



(«-l)ntj,, 



j=0 



(i) 

(i-l)nd,a+l 



^„ ^('-l)"d,a+"d,<:«-l 
J=0 



for / = 1,2, ... , {udjCtd), then, following the same reasoning employed for proving formula 
([3T]) . we infer 

/n[0]-e \ I f ^"'''"''^ \ 



where 



1 1 ••• 1 
1 1 ••• 1 

1 1 ••• 1 

V 

(nd,Od) times 



1 



[nd, ad 



-Eig(J(„„.,)) = {0,1}, 
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and 



("ti,Od) ind,ad) /n.[0]-e 

^ = diag Yl 1ii-i)nd,^+k^ /c = 0, 1, . . . , nd,a - 1 

i=l Z=l \ j=0 

({n.d,Oid)n[0]-e 
Yl Yl ^(/-i)n, ^+k^ = 0, 1, . . . , n^,, - 1 
1=1 j=0 



{nd,ad) 

Consequently, since ^ is a diagonal matrix, and by exploiting basic properties of the 
1=1 

tensor product, we find 



(™d>Od)"[0]-e 



(i) 

(«-l)nd,a+fc 



, k — 0,1, ... , TLd rt 1, 



j=0 
■nfOl-e 



j=0 



1=1 j=0 

0, k = nd,a,- ■ ■ ,nd- I- 



Now, since Yl^=o ^j^j ^ positive semidefinite matrix, from (j73p we finally have 
/ 



V 

/ /nfl 



1/2N 



1/2N 



(nd,ad)n[0]-e 

X] ^a-i)nda+fc' ^ = 0, 1, . . . ,nrf,„ - 1, 

«=1 j=0 



j=0 



0, k = nd,a,---,nd-l. 



7 Conclusions and future work 

In this paper we have studied in detail the singular values of a-circulant matrices and we have iden- 
tified the joint asymptotic distribution of a-Toeplitz sequences associated with a given integrable 
symbol. The generalization to the multilevel block setting has been sketched together with some 
intriguing relationships with the design of multigrid procedures for structured linear systems. The 
latter point deserves more attention and will be the subject of future researches. We also would 
like to study the more involved eigenvalue/eigenvector behavior both for a-circulant and a-Toeplitz 
structures. 
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